Skip to content

Conversation

sjmonson
Copy link
Collaborator

@sjmonson sjmonson commented Oct 18, 2025

Summary

Fixes tests whenever possible and marks remaining ones as XFAIL.

Test Plan

  • Run unit tests with tox -e test-unit
  • Run integration tests with tox -e test-integration
  • To see remaining broken tests, run with: tox -e test-unit -- --runxfail

  • "I certify that all code in this PR is my own, except as noted below."

Use of AI

  • Includes AI-assisted code completion
  • Includes code generated by an AI application
  • Includes AI-generated tests (NOTE: AI written tests should have a docstring that includes ## WRITTEN BY AI ##)

@sjmonson sjmonson force-pushed the features/refactor/more_unit_tests branch 3 times, most recently from 3f0ac0e to dabe4b6 Compare October 20, 2025 23:26
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
@sjmonson sjmonson force-pushed the features/refactor/more_unit_tests branch 2 times, most recently from ba9203f to 64aa2fe Compare October 20, 2025 23:38
@sjmonson sjmonson marked this pull request as ready for review October 20, 2025 23:39
@sjmonson sjmonson changed the title Fix failing tests Fix failing unit tests Oct 20, 2025
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR fixes failing unit tests across the codebase, with most changes involving updates to reflect API changes in request/response schemas and class renames. Several tests that couldn't be fixed are marked as XFAIL with run=False.

Key changes:

  • Updated test code to use new schema names (RequestInfo, RequestTimings instead of ScheduledRequestInfo, MeasuredRequestTimings)
  • Replaced deprecated/removed classes and methods related to request timing strategies
  • Marked unfixable tests with pytest.mark.xfail(reason="old and broken", run=False)

Reviewed Changes

Copilot reviewed 21 out of 21 changed files in this pull request and generated 6 comments.

Show a summary per file
File Description
tests/unit/utils/test_text.py Added XFAIL marker to broken test
tests/unit/utils/test_messaging.py Updated imports and class names from ScheduledRequestInfo to RequestInfo
tests/unit/utils/test_encoding.py Updated imports and class references for renamed schemas
tests/unit/testing_utils.py Fixed logic order in async_timeout decorator
tests/unit/test_main.py Added XFAIL marker to broken test
tests/unit/scheduler/test_worker_group.py Major refactoring to remove deprecated timing registries and update test parameters
tests/unit/scheduler/test_worker.py Updated to use new strategy-based timing instead of separate timing classes
tests/unit/scheduler/test_strategies.py Removed tests for deleted timing classes, inlined calculations
tests/unit/scheduler/test_scheduler.py Updated imports and added missing startup_duration parameters
tests/unit/scheduler/test_objects.py Renamed test classes and updated to new schema names
tests/unit/scheduler/test_environment.py Updated RequestInfo import and usage
tests/unit/scheduler/test_constraints.py Updated RequestInfo import and usage
tests/unit/preprocess/test_dataset.py Added XFAIL markers to broken tests
tests/unit/mock_benchmark.py Updated mock object to use new schema structure
tests/unit/mock_backend.py Updated imports and class usage
tests/unit/benchmark/test_output.py Updated test setup to include required args parameter
tests/unit/backends/test_openai_backend.py Major refactoring to align with new backend API structure
tests/unit/backends/test_objects.py Updated to test new request/response schema structure
tests/unit/backends/test_backend.py Updated to use new schema names
src/guidellm/scheduler/init.py Removed exports for deleted timing classes
pyproject.toml Excluded tests directory from mypy checking

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@sjmonson sjmonson force-pushed the features/refactor/more_unit_tests branch from 64aa2fe to 3add86f Compare October 20, 2025 23:51
@sjmonson sjmonson changed the title Fix failing unit tests Fix failing tests Oct 21, 2025
@sjmonson sjmonson merged commit 2cbb7c9 into main Oct 21, 2025
12 of 17 checks passed
@sjmonson sjmonson deleted the features/refactor/more_unit_tests branch October 21, 2025 01:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants